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Abstract 

Ergodicity is a fundamental issue for a stochastic process. In this paper, we refine results 
on ergodicity for a general type of Markov chain to a specific type or the GI/G/ 1-type 
Markov chain, which has many interesting and important applications in various areas. It 
is of interest to obtain conditions in terms of system parameters or the given information 
about the process, under which the chain has various ergodic properties. Specifically, we 
provide necessary and sufficient conditions for geometric, strong and polynomial ergodicity, 
respectively. 

Keywords: Ergodicity, geometric ergodicity, strong ergodicity, polynomial ergodicity, tail 
asymptotics, geometric decay, light tailed, heavy tailed, queueing system, GI/G/l-type. 



1 Introduction 

Ergodicity is a fundamental issue in the study of a stochastic process. There are many references 
in this area, among which closely related to our study include books by Anderson [1] , Meyn and 
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Tweedie [21] . Chen [1], and references therein. Results in these books are usually presented for 
a general type of stochastic process, or Markov chain, while our focus is on a specific type of 
Markov chain; that is, the GI/G /1-type Markov chain. We apply standard methods used for 
a general process, combined with various techniques in dealing with block-structured matrices, 
to characterize ergodic properties in terms of system parameters, which is an extension of the 
existing research. 

The Crl/Cr/l-type Markov chain is a very important type of block-structured stochastic 
process with many applications in queueing theory; for example, see Grassmann and Heyman [7], 
Zhao, Li and Braun |23|. 125] . and Zhao [23]. We refine literature results on general Markov chains 
to obtain ergodicity conditions for this specific type of Markov chain. In this paper, we focus 
on the study of ergodicity of this type of Markov chain. For the GI/G /1-type Markov chain, 
the ordinary ergodicity has been well studied. Necessary and sufficient conditions have been 
reported in the literature; for example, see Asmussen [2], Zhao, Li and Braun [231 I25j . and 
Zhao |24j . This will not be discussed again in the current paper. Instead, we will consider three 
other types of ergodicity: geometric, strong (or uniform) and polynomial. Related results were 
reported in Spieksma and Tweedie [22j . 




Related to our research, Hojgaard and M0ller [8], using the coupling method and stopped 
random walks, provided a sufficient condition for geometric and polynomial ergodicity, respec- 
tively, for the GI/G /1-type Markov chain. Hou and Liu [IOj derived a necessary and sufficient 
condition for polynomial ergodicity for the M/G/l queue by analyzing the generating function 
of the first return probability, and extended their study to the M/G /1-type Markov chain in 
Liu and Hou [18] . Jarner and Tweedie [13] proved that for random- walk-type Markov chains, 
the geometric (light) and polynomial tail asymptotics in the stationary probability distribution 
are necessary for the geometric ergodicity and polynomial ergodicity, respectively. 

The main contributions in this paper include necessary and sufficient conditions (Theo- 
rem [3TT1 Theorem 14. 1] Theorem 1 5 . 2 1 and Theorem 15 .3p for each of these three types of ergodicity, 
given in terms of system parameters, or the given information about the GI /G/l-type Markov 
chain. 

Ergodicity and tail asymptotics of the stationary probability distribution are usually studied 
separately because of the obvious distinction between these two concepts. For a stochastic pro- 
cess, ergodicity deals with conditions under which the marginal distribution at time t converges 
to its limiting distribution in various speeds as t goes to infinity, while the tail asymptotic of 
the stationary (limiting) probability distribution is concerned with the speed to zero of the tail 
probabilities. It is interesting to observe that the same necessary and sufficient condition for 
both geometric ergodicity and a geometric decay in the stationary probability distribution im- 
mediately allows us to draw the conclusion of ergodicity on a number of important models for 
which the tail asymptotics have been known, and vice versa. The equivalence also opens a new 
door for us to take advantage of possibly using newly developed approaches and known results 
in studying ergodicity to study tail asymptotics of the stationary probability distribution. For a 
symmetric Metropilis-Hastings algorithm, Mengersen and Tweedie |20j and Jarner and Hansen 
[12] proved that these two concepts are actually equivalent. It is our goal to provide necessary 
and sufficient conditions for ergodicity for the GI /G/l-type model in this paper. 

The rest of the paper is organized into four sections. In Section 2, the GI /G/l-type Markov 
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chain is reviewed, and a spectral property, Lemma 12.31 is obtained that plays a key role in 
proving the main result for geometric ergodicity. Sections 3-5 study geometric, strong and 
polynomial ergodicity, respectively. 



2 The GI/ G/l-type Markov chain 



Consider a discrete time irreducible aperiodic Markov chain, whose transition probability matrix 
is given by 



P 



( -Po,0 -fb,l -fb,2 Pq,3 " " " \ 

Pl,0 Pl,l P\,2 Pl,3 

P2,0 Pl,\ P%,2 P2,3 
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(2.1) 



where Ai and Bi for i = 0, ±1, ±2, ■ ■ ■ , are matrices of size m x m. The state space for the 
Markov chain P can be expressed by S = U^gLj, where Li = = 1,2, ... , m} for i > 0. 

In a state (£, j), z is referred to as a Zei>e/ and j as a phase. We also write L<j 



Remark 2.1 In /acf, we can more generally assume that Bo is a matrix of size mo x mo with 
mo 7^ m for the results obtained in this paper. 



Along the same line as in [23J, we define the R- measures R4 j for i < j and the G- measures 
Gij for i > j for the GI /G/l-type Markov chain. Pjj- is a matrix of size m x m whose (r, s)th 
entry is the expected number of visits to state (J, s) before hitting any state in L<^_ 1 ), given 
that the process starts in state (i, r). Gij is a matrix of size mx m whose (r, s)th entry is the 
probability of hitting state (j,s) when the process enters L < ^ i _^ for the first time, given that 
the process starts in state (i, r). We refer to the matrices Rij and Gij as the matrices of the 
expected number of visits to higher levels before returning to lower levels and the matrices of 
the first passage probabilities to lower levels, respectively. From |23j, we can write R n —i — R4 n 
and G n -i = G n ^i for i > due to the property of repeating rows. If the GI /G/l-type Markov 
chain is positive recurrent, then the stationary distribution {i^k} can be expressed in terms of 
the R- measures (see [7]): 

n-l 

TTn = 7ToRo,n + ^^kRn-k, TV > 1. (2.2) 
k=l 

Define the generating functions for the stationary distribution {n^}, the matrix sequences {i?o,fe} 
and {R k }, respectively, as tv*(z) = EZo^k, R*o( z ) = ZT=i zkR o,k and R*(z) = ££Li**^fc- 
Then, we have that 

7v*(z)[I-R*(z)]=7VoR*o(z). (2.3) 

Throughout this paper, we assume that the phase process A = YlT=-oo Ak is irreducible. 
Therefore, when A is stochastic in addition, there is a unique invariant probability vector /x of 
A, that is n = \iA. 
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Definition 2.1 For a sequence {ck} of nonnegative scalars, it is called light-tailed if 

oo 

c k e ek < +00 

fc=i 

for some e > 0. For a sequence {C k } of nonnegative matrices of size m x n, it is called light- 
tailed if for all i = 1, 2, • • • m and j = 1, 2, • • • , n, i/ie sequences {C/% (i, j)} 0/ nonnegative scalars 
are light-tailed, where C k (i,j) is the (i,j)th entry of C k . 

Let A* + (z; r, s) and B+{z\ r, s) be the (r, s)th entry of the matrix generating function A* + {z) = 
J2t=iAk zk an d B+i z ) = Ylh=i BkZ k , respectively. Denote by <pA+(r, s) and <pB+(r,s) the 
convergence radii of A(z;r, s) and B(z;r,s), respectively. Let 

4> A+ = mm 4> A+ (r,s) 

r,s 

and 

4> B + = mm 4> B +(r,s). 

r,s 

In Li and Zhao [151 H6j . they proved the following. 

Lemma 2.1 When A is stochastic, for the GI/G/l-type Markov chain, the sequence of the 
stationary probability vectors {n^kyi is light-tailed if and only if min(<^ + , 4>b+) > 1> or both 
{Ak}k>i an d {Bk}k>i are light-tailed. 

Define A*(z) = Yl/k=-oo zk ^k- Then, according to Li and Zhao [16] . we have the following 
spectral property. 

Lemma 2.2 Suppose that the GI /G/l-type Markov chain defined in h2. 1\) is irreducible, ape- 
riodic and positive recurrent. If D, = {1 < \z\ < 4>a+ '■ det(J — A*(z)) = 0} is not empty, then 
there must exit a positive z$ £ 0, such that zq < \z\ for z £ O. 

Define n = zq for Q ^ 0; n = 00 for fl = 0. Let x( z ) for z > be the largest eigenvalue of 
A*(z). We have the following spectral property. 

Lemma 2.3 Assume that A is stochastic and 4>a+ > 1 for the irreducible aperiodic positive 
recurrent GI /G/l-type Markov chain defined in \2.1\) . Then x( z ) < 1 f or any 1 < z < 
min(<^4_)_, 77), and there exists a Perron- Frobenius eigenvector Y{z) with Y(z) > e* such that 

A*(z)Y(z) = X (z)Y(z), (2.4) 

where e is a row vector of ones and e* is the transpose of e. 

Proof: Without loss of generality, assume that r\ < 4>a+- Since x(l) = x(v) = 1) it follows 
from the continuity of x(') and the definition of n that we only need to show that x'(l) < 0. 
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Differentiating both sides of equation (|2.4p at z = 1 gives 

A*'(l) x (l) + = x'(l)Y(l) + X(X)Y'(1). 

Note that because A*(l) = A,A*'(1) = YlT=-oo kA k and Y (!) = e *> the lemma follows from 
the ergodicity condition 

oo 

X'(l)=^ ^ kA^KQ. 

k=—oo 

□ 

3 Geometric ergodicity 

In this section, we present a necessary and sufficient condition for geometric ergodicity, which 
is the same condition for a geometric tail in the stationary probability distribution. 

Let P n ((i,r), (j, s)) be the n-step transition probability for the irreducible and aperiodic 
Markov chain of GI/G/1 type given in (|2.ip . P is called geometrically ergodic if there exists a 
rate p < 1 such that 

\P n ((i, r), (j, s)) — 7Tj jS | < Mu r \(j >s \p n , for all n > and for all r, s, 

where 7Tj iS is the stationary probability in level j and phase s and Mn r \/j iS \ < oo. It follows from 
Theorem 4.31 in Chen [3j that geometric ergodicity is equivalent to the following condition. 

Condition 3.1 There exist a finite set H ^ 0, a constant A < 1 and a finite function V > 1 
defined on the state space of the Markov chain P, such that 

PV(i,r) < XV(i,r), for 
PV(i,r) < oo, for (i,r) G H. 

See also Anderson [1] or Meyn and Tweedie [21]. 

When A is stochastic, the GI/G/l-type Markov chain is a special case of the random-walk- 
type Markov chain in Jarner and Tweedie [13] . so it follows from Theorem 2.2 of [13] that the 
condition in Lemma [2.1l or min(0yi + , 0b+) > 1 is necessary for P to be geometrically ergodic. To 
show the equivalence between the geometric ergodicity and geometric stationary tail as stated 
in Lemma [2TH we only need to show that under the assumption min(^A+, 4>b+) > 1, (|3.5|) holds. 

Theorem 3.1 Assume that A is stochastic and mm(<pA+, > 1 for the irreducible aperiodic 
positive recurrent GI /G/l-type Markov chain defined in \2.1\) . \3. 5\) holds for V(i, r) = z l y r for 
any 1 < z < min(0A+, (f>B+, v)> where Y := Y(z) = (yi,y2, • • • ,ym) 1 is the right eigenvector of 
A*(z) corresponding to the eigenvalue x( z ) given in Lemma \2.3[ 
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Proof: For any fixed 1 < z < min(</) J 4 + , <t>B+, v)i 5 := 1 — xi z ) > by Lemma 12.31 Let N be 
large enough such that az~ N < 5/2 or N > (log 2a — log 5)/ log z, where a = maxi< r < m y r > 1. 

Set H = L<at, a finite set. Then, for (i, r) H or i > N, we have 

oo 

Pi>(i) := ^ Pj,fc^fc = B-iV o + A-i+ii?! + A„ i+2 v 2 + H 

fc=o 

= (P_^ + A. i+l z- i+1 + yl_ i+2 z- i+2 + A^ i+3 z- i+3 + ---)z l Y 

< z i {B^z^Y + A*(z)Y) < z i (az- N e t + A*(z)Y) ^ 

= z l {az- N e t + (1 - S)Y) < z l (az- N + (1 - 5)) Y 

<(i-gK 

where ^ = (V(i, 1), V(i, 2), . . . , V(i, m))* = z*Y\ 
For any < % < N, 

B^v + A- i+ iVi + A_ i+2 v 2 + + • • • < ae* + s^A*{z)Y < oo, 

and for i = 0, 

P ^o + Pi^i + P2f2 + B 3 v 3 H = P r + P+(z)^ < 00. 

□ 

The equivalence of geometric ergodicity and the geometric stationary tail is interesting since 
results of ergodicity could directly lead to results of the stationary tail asymptotics and vice 
versa. 



4 Strong ergodicity 

In this section we show that the phase process A is not stochastic if and only if the GI/G/l-type 
Markov chain is strongly ergodic. 

Theorem 4.1 The GI/G/l-type Markov chain is strongly ergodic if and only if A is not stochas- 
tic. 

Proof: Assume first that A is not stochastic. Let To = inf{n > : X n E Lq}, then by 
Proposition 3.3 on page 216 in Anderson p], we only need to prove that there exists an M < 00 
such that 

x i r ■= E(j r )To < M, for all 1 < i < 00 and 1 < r < m. 

Let X, L = (x^i, • • • fX^mY for i > 1 and Xq = (xo,i, ■ ■ ■ , xo,m )* = 0; then {Xi : i > 0} is the 
minimal non-negative solution of 

Yi = J2 p i,kYk + e\ i>l, (4.7) 
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where i^o = 0. 

Since A is irreducible and not stochastic, (I — A)~ 1 = I + A + A 2 + ■ ■ ■ exists and is finite. 
In the following, we will prove that Xj < (I — A)~ 1 e. In fact, by a standard procedure for the 
minimal non-negative solution (for example, see [9]), set X^ = 0, and for n > 1, let 

xf =£P iife X^ + e*, i>l, andX^=0, 

we can then inductively prove that if xf 1 l) <{I - A)~ l e\ then for i > 1, 

X W < £ p . fc(/ _ A) -i e t + c < < A(J _ A) -i e t + c * = (J _ A) -l e t_ 

Thus, Xi = lim^oo X[ n) < (I - A) -1 e* < oo. 

For the converse, assume that A is stochastic. It is obvious that P is a Feller transition 
matrix, thus P cannot be strongly ergodic by Proposition 2.3 in Hou and Liu [10]. □ 



5 Polynomial ergodicity 

As indicated in the introduction, a sufficient condition for polynomial ergodicity was obtained 
in H0jgaard and M0ller [8]. In this section, we prove that it is also necessary . In addition, 
we provide another necessary and sufficient condition for polynomial ergodicity. To achieve this 
goal, in the first sub-section, we construct a control function h based on transition probabilities 
and provide a lower bound for the first hitting time. We also find a relationship between the 
first hitting times and transition probabilities. In the second sub-section, proofs of the main 
results are provided. 

5.1 Lower bounds for the first hitting time 

In this sub-section, we derive lower bounds for the first hitting time Tj = inf{n > 1 : (X n ,Y n ) £ 
L{}, for any finite i, which are useful to discuss necessary conditions for ergodicity. We provide 
a lemma for tq. Similar results can be obtained for any i ^ by the same argument. In fact, 
we can have a corresponding result for the first hitting time of any finite set instead of a level. 
We also obtain a relationship between the first hitting time and transition probabilities. 

oo oo 

Lemma 5.1 If ^ kB^e 1 < oo* and ^ kA^e 1 < oo*, then (1) for i large enough, we have, 

k=0 k=0 

P(Ci) > \, where d = \{X S ,Y S ) G (\jH iJ O for s = 0, 1, . . . , [^J j and [x\ denotes 

the largest integer equal to or smaller than x; (2) for each sample on the event to Cj which 
satisfies (1), 

ro - 1 > (5.8) 

where fi > is some fixed constant. 
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Proof: Since we consider the level independent GJ/G/l-type Markov chain, we have, for i > 1 
and j = 1, . . . , m, 



'i+(fc-l) 

(Xi,yi) el [J l„ 



'i+(fc-i) 

[ (Xi,yi) G I |J L u \ 1 , for any fc > 0, 



u=l 



where L c denotes the complement of L and P( ijJ -)((Xi, y) € • ) = P((Xi,y) G • \(X ,Y ) 
Without loss of generality, we assume that 



(X 1 ,Y 1 ) G (\JL U \ 
\u=0 J 



■ max 

j 



(Oj) 



j = 1,. . . ,m 



and 



(IJa) 



: max < 

i 



'l+(k-l) 
(X!,y) G [ (J L u 

U=l 

/l+(fc-l) 

P (1J) [ (X!,y)G |J L u 
V u=l 



j = 1, ... ,171 



Let 

/i(A;) = max < 
Notice that 

and 



/fc-l \ u \ / /!+(*-!) 

(X!,y) g MJ lJ , p (1j2) (X!,y) g |J 

, \m=0 / / \ \ u=l 



(Oji) 



(^ y i) e Um <0 °' 



fc=i 

oo 
fc=0 



vu=0 



'l+(fc-l) 

(X!,y) el [J l„ 



< oo 



tt=l 



since Yl kB^e 1 < oo* and Yl kA^e 1 < oo*. Hence 

k=0 k=0 

oo 

y~^^(fc) < oo. 

k=l 

It is easy to know that for alH > 0, j = 1, . . . , m and k > 0, 



(iJ) 



^+(fe-i) 

(X!,y) g [ (J l u \ 1 



and h(k) is a non-increasing function. Therefore there exists a sequence oii.i.d. random variables 
W n > with mean \x = E[W n ] such that for all i > and all k > 0, 

/ A+(fc-i) \ c \ 

By the weak law of large numbers, we claim that for any e > 0, 

lim F(S n < (n + e)n) = 1, 

n— »oo 

where S n = W\ + • • • + W n . Hence there exists an N large enough such that for n > N, 

1 



n < 2/in) > 

Then, a stochastic comparison argument yields, for all i > and all n > N, 
P (i)i) f (X S ,Y S ) G f |J L u l for a = 0,l,...n) >-. 

For i large enough such that j- > N, we have from (|5.9p with n 



(5.9) 



> iV that 



(X s ,y s ) e [J L„ for s = 0,1,... 



4/i. 



> 



Set a = <! F s ) G ( Uli fj i u ) for s = 0, 1, . . . , ± \, then we have that P(Q) > ± 



4 M 

Therefore, for i large enough, we have, for each sample on the event C% 



T0-1 > 



4/z 



> 



% - 1 
1^' 



□ 



Corollary 5.1 Given any non-negative, non- decreasing and measurable function f ', if E(o,j)[/( 7 o)] < 

oo oo 

oo for j = 1, 2 . . . , m, ^ kBke 1 < oo*, and ^ kA^e 1 < oo* ; i/ien /or i /arye enough, we have 

k=0 k=0 



M (iJ) [f(r -!)]>-/ 



1 . / »- 1 



4// 



(5.10) 



where fi > is some fixed constant. 



Proof: From Lemma 15.11 we know that for i large enough such that 



(X S ,Y S ) G [j L u \ for s = 0,1,..., 



4/i. 



> 



1 



(5.11) 
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Hence for i large enough, we have for the above event 



and therefore 



70-1 > 



/(to - 1) > / 



4/z 



> 



i - 1 



>/ 



i- 1 



For z sufficiently large, this event has a probability of at least | by (|5.1ip and therefore for i 
sufficiently large, 

E (iii) [/(ro-l)]>i/ //_ ' 



4/i 



where ^ = E[W n ] > is some fixed constant. 



□ 



Remark 5.1 Specifically, if for I S {2, 3, . . . }, f(x) = x l , then for i large enough, we have 

l 



(t-o-1 



> lfi-l 



2 V 4/i 



(5.12) 



where ji > is some fixed constant and E(ij) [(tq — 1)'] = E [(tq — l) z |(Xo,lo) = (hj)] ■ 



Next, we discuss the relationship between the first hitting time and one-step transition 
probabilities, which leads to a necessary condition for polynomial ergodicity. 



Lemma 5.2 If for I € {2, 3, . . . }, E( j)[tq] < oo ; for j = 1, . . . , m, we have 



E 



(o,j) 



T ol = EE E (M f( T o + 1 W(*i.* r i) = (M)), 



fc=0 i=l 



and 



E (u) ^ =EE e (m ( T o + 1 )' P(i >j )((^i,i r 1 ) = (fc,o), 



(5.13) 



(5.14) 



k=0 i=l 



where F (0d) ((X u Y x ) = (k,i)) = P((Xi,Yi) = (k,i)\(X ,Y ) = (0,j)) and P (lj , ) ((X 1 , n) 
(k,i))=F((X u Y 1 ) = (k,i)\(X ,Y ) = (l,j)). 



Proof: Given I € {2, 3, . . . }, we have that for j = 1, . . . , m, 
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E 



(0,3) 



oo m 



P {0)i) ((X 1 ,F 1 ) = (A;,0) 
^EE^ = n l(*i,^i) = (M)P(0,i)((*l,*l) = (M)) 

fc=0 i=l n=l 

oo m oo 

EEE^ = n- i|(x ,y ) = (M)P(o,i)((*i' y i) = (M)) 

fc=0 i=l n=l 

oo m oo 

^Qnll/Pt^nKlo.yo) = (A;,z))P { o J )((X 1) F 1 ) = (k,i)) 



k=0 i=l 

oo m oo 



fc=0 i=l n=l 
oo m 



fe=0 i=l 

Similarly, we can prove the other case. 



□ 



Remark 5.2 in /act, /or any non-negative and measurable function f , we can have decomposi- 
tions corresponding to Lemma \5.2\ for /(to). 

5.2 Necessary and sufficient conditions for polynomial ergodicity 

In this sub-section, we discuss polynomial ergodicity for the GI /G/l-type Markov chain and 
provide two necessary and sufficient conditions. 

The GI/G/l-type Markov chain is called polynomial ergodic of degree I for I 6 {1,2, . . . }, 
if for all j = 1, . . . , m, 

(5.15) 



E 



(oj) 



< oo. 



If I = 1 in equation 15.151 this definition coincides with the ordinary ergodicity. 

We first use the lemmas from the previous sub-section to obtain a necessary condition for 
polynomial ergodicity. 



Theorem 5.1 If for I £ {2,3, 
then 

and 



}, E(oj) [tq] < oo for all j = 1, . . . , m, and ^ kA^e 1 < oo* ; 



fc=0 



^£;'yl fc e* < oo*, 
fe 

Y^^B k e* < oo*. 
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Proof: Given I G {2,3,...}, by Corollary 15.11 for j = 1, . . . , m, we have for all k > N, 
where N is large enough, 



Then, by Lemma 15.2 



E 



(M 



(to - 1)' 



> I ' k ~ 1 



2 V 4/i 



(5.16) 



E (oj) 



r o = EE E (M ( r o + 1 )' P(0j)((^i,51) = (*,*)) 



fe=0 i=l 
AT m 



fc=0 i=l 



oo m 



> 



+ E E E M ^o + i)'Jp (OJ )PiTi) = ft^ 

fc=jV+l i=l 



E ^ e< 

,fc = AT + l 



where 



£ *^e* 

fc=AT+l 



denotes the jth element of vector £ k l B k e^ . Hence 

k=N+l 



and therefore 



Similarly, we can obtain 



k l B k e f < oo* 

k=N+l 

Y^Bue 1 < oo*. 

k 

k l A k e t < oo*. 



□ 



Remark 5.3 77ms theorem can be extended to a class of more general non-negative and non- 
decreasing rate functions. 

A necessary and sufficient condition for polynomial ergodicity can now be obtained since 
Hojgaard and M0ller [8J have already showed that the converse of Theorem l5.1l is also true. We 
state it as follows. 



Theorem 5.2 If Yl kA k e l < oo*, then for J € {2, 3, ... }, E(oj) [tq] < co for all j = 1, . . . , 



fc=o 



if and only if J2k ^A^e 1 < oo* and J2k ^B^e 1 < oo*. 
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Proof: For necessity, it follows from Theorem 15.31 



□ 



Next, we provide another necessary and sufficient condition for polynomial ergodicity based 
on the relationship between ergodicity and the tail behavior of the stationary distribution for 
the GrJ/G/l-type Markov chain. The following lemma from Jarner and Tweedie [13] is needed. 

Lemma 5.3 Assume that for I € {2,3, ... }, E(oj) [ r o] < 00 f or 3 = 1) • • • > m > there exists a 
finite set (without loss of generality, we assume that this finite set is Lq) such that 



oo 
i=Q 



7Tjj < OO, 



(5.17) 



where tt^ is the jth element of ~K{. 

Using Lemma 15.21 Lemma 15.31 and factorization results, we have the following condition. 



Theorem 5.3 // Yl kA^e 1 < oo, then for I G {2, 3, . . . }, E(oj) [tq] < oo for all j = 1, . . . , m 

k=0 

if and only if ^ i l Hij < oo. 

Proof: For necessity, by Corollary 15. 1\ for a given I € {2, 3, . . . } and all j = 1, . . . , m, we 
have for all i > N, where N is large enough, 



Then by Lemma 



Thus 



E (w) 



(t - iy 



> 



1 (% - 1 



2 V 4 /" 



00 >£%;) 

i=0 
N 



7T, 



IJ 



oo 
i=N+l 



7T 



i=iV+l 



< oo. 



(5.18) 



For sufficiency, we use factorization results and generating function techniques in our analysis. 
From ([2T31) we have that for < z < 1, 

7V*(z)[I-R*(z)]=7V R^z), 

n*(z) = n* R* (z)[I-R*(z)}-\ (5.19) 



and thus 
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since / — R(z) is invertible. Taking the Ith (I = 2,3,...) derivative on the both sides of 
equation (|5.19p . we have 



Y k(k-l)---(k-l + l)z k - l n k 

k=l-l 

oo oo oo 



k 



=7T y k ( k - !) • • • ( fc - 1 + l ) zk ~ lR ^ Y zk E r t ( 5 - 2 °) 

k=l-l k=l n=0 

oo oo oo 

+ n J2 zkR o,k Y Hk I + l)z k - l Y R k* + ci-i(z), 

k=l k=l-l n=0 

where q_i(^) is the summation of all terms of the form 

oo oo oo 

7T Y k(k-l)---(k-p+l)z k - p R , k Y Kk-l)---(k-q + l)z k - q Y R 

k=p—l k=q—l n=0 

and 

p + q < I — 1. 

There are only finitely many such terms of this kind. Let z — > 1— in ()5.20j) . we obtain 

oo 

Y Kk - 1) • • • (k - I + l)7r fe 

oo oo oo 

=7T ^ ^-l)...(i-I + l)fi ^^fi»* 

fc=Z-l fc=l n=0 

oo oo oo 

+ vr ^i?o,fc 2 k(k-l)---(k-l + l)Y R k* + Ci-iW- 

Since ^ i'7Tj < oo and 



fc=l fc=i-l n=0 



it follows that 



Therefore 



.. - 1) - - • (fc - Z + 1) n 
, lim □ = 



Y k(k - 1) ■ ■ ■ (k - l + l)ir k < oo. 

k=l-l 
oo 

^ fc(]fe - 1) • • • (Jfe - I + l)Ro, k < oo 

k=l-l 



and 



Thus 



OO 

oo. 

fc=Z-l n=0 



Y k{k-i)...(k-i + i)Y R T < 



Y k l Ro,k < oo 



k=l 
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and 

oo oo 



E k l J2 RT < v . 



k=l n=0 



From Theorem 1 in [7] and Theorem 12 in [24] . we have for k > 1, i?o,fc > -Sfe an d Rk > ^4fc- 
Hence, 



oo oo oo oo 



t -no, fee <^ ex.-* 

fc=l fe=l 

and 

E fcu*e* < E fc/ E ^ v < E *T ^ < «>'• 

fc=l fc=l n=0 fc=l n=0 

Finally, by Theorem 15. 2\ we know that E( ^ [tq] < oo . □ 
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